Text Processing

Back to Home

01. Text Processing
02. Coding Examples
03. Capturing Text Data
04. Normalization
05. Tokenization
06. Cleaning
07. Stop Word Removal
08. Part-of-Speech Tagging
09. Named Entity Recognition
10. Stemming and Lemmatization
11. Exercise: Process Tweets
12. Text Processing Coding Examples
13. Summary

Back to Home

05. Tokenization

Tokenization

INSTRUCTOR NOTE:

Reference:

nltk.tokenize package: http://www.nltk.org/api/nltk.tokenize.html

Learn Udacity: click here to learn more :)